Howell's [question, comment]s related to Grossberg's book

• p018fig01.12 Howell: grepStr 'Peak shift|behavioural contrast'- Leonid Perlovsky: the thirst for knowledge
• p025fig01.17 Howell: grepStr 'Sensory-drive heterarchy|drive hierarchy'- are "multiple conflicting hypothesis" kept on hand? It seems that is the case to some extent during processing, but what about longer-term? One can derive all kinds of concepts based on [known, assume, speculate]ive connections? Eg Robert Hecht-Nielson thalamo-cortical loops and assessing many possibilities, selecting one.
• p040 Howell 24Jul2023, Grossberg 2021 p040c2h0.80 : so I must sometimes be cutting off my thinking at a sub-conscious level, which explains my "disastrous consequences"...
• p040 Howell 24Jul2023, Grossberg 2021 p040c2h0.80 : It appears to me that the same [microcircuit, modal architecture] in the brain may be conscious in one situation (for example when producing results for simple decision-making), and non-conscious in another (when the outputs must be considered in the context of more complex, multiple [modes, environmental scenarios]?).
• p044 Howell: grepStr 'conscious' - A linking hypothesis between resonant brain dynamics and the conscious mind
• p126fig04.03 Howell: grepStr '????' (source?): strange multi-bright-color painting of WWII ships. I don't actually see illusion in p126fig04.03?
• p153 Howell: grepStr 'uncertainty' "multiple conflicting hypothesis"- a slef-imposed practice to avoid becoming a [believer, tool] of a concept. But this wasd intended for [long-term, well-established, mainstream] theories, and well as new ideas that excite me. Does Grossberg's uncertainty" concept also allow for "multiple conflicting hypothesis" to sit there and brew?
• p184 Howell: grepStr 'conscious' - including: Some other approaches to understanding consciousness (Grossberg 2021 p47c1h0.5) :
• p184 Howell: grepStr 'conscious' - rapidly learn to categorize and recognize so many objects in the world
• p184 Howell: grepStr 'conscious' - remember this information as well as we do over a period years
• p184 Howell: grepStr 'conscious' - learn to expect and anticipate events that may occur in familiar situations
• p184 Howell: grepStr 'conscious' - pay attention to events that are of particular interest to us
• p184 Howell: grepStr 'conscious' - become conscious of these events
• p184 Howell: grepStr 'conscious' - balance between expected and unexpected events, and orient to unexpected events
• p184 Howell: grepStr 'conscious' - engage in fantasy activities such as visual imagery, internalized speech, and planning
• p184 Howell: grepStr 'conscious' - learn language quickly and consciously hear completed speech sounds in noise
• p184 Howell: grepStr 'conscious' - hallucinate during mental disorders
• p184 Howell: grepStr 'conscious' - "... I claim that a common set of brain mechnisms controls all of these processes. Adaptive Resonance Theory, or ART, has been incrementally developed to explain what these mechanisms are, and how they work and interact, since I introduced it in 1976 [Grossberg, 1976a, 1976b] and it was incrementally developed in many articles to the present, notably with the help and leadership of Gail Carpenter, as I will elaborate on below. There are many aspects of these processes that are worth considering. For example, we need to understand between... ..." [Grossberg 2021 p184]
• p190 Howell: [neural microcircuits, modal architectures] used in ART -

  bottom-up filters	top-down expectations	purpose
  instar learning	outstar learning	p200fig05.13 Expectations focus attention: [in, out]star often used to learn the adaptive weights. top-down expectations to select, amplify, and synchronize expected patterns of critical features, while suppressing unexpected features
  LGN Lateral Geniculate Nucleus	V1 cortical area	p192fig05.06 focus attention on expected critical features
  EC-III entorhinal stripe cells	CA1 hippocampal place cells	p600fig16.36 entorhinal-hippocampal system has properties of an ART spatial category learning system, with hippocampal place cells as the spatial categories
  auditory orienting arousal	auditory category	p215fig05.28 How a mismatch between bottom-up and top-down patterns can trigger activation of the orienting system A and, with it, a burst of nonspecific arousal to the category level. ART Matching Rule: TD mismatch can suppress a part of F1 STM pattern, F2 is reset if degree of match < vigilance
  auditory stream with/without [silence, noise] gaps	perceived sound continues?	p419fig12.17 The auditory continuity illusion: Backwards in time - How does a future sound let past sound continue through noise? Resonance!
  visual perception, learning and recognition of visual object categories	motion perception, spatial representation and target tracking	p520fig14.02 pART predictive Adaptive Resonance Theory. Many adaptive synapses are bidirectional, thereby supporting synchronous resonant dynamics among multiple cortical regions. The output signals from the basal ganglia that regulate reinforcement learning and gating of multiple cortical areas are not shown. red - cognitive-emotional dynamics green - working memory dynamics black - see [bottom-up, top-down] lists
  EEG with mismatch, arousal, and STM reset events	expected [P120, N200, P300] event-related potentials (ERPs)	p211fig05.21 Sequences of P120, N200, and P300 event-related potentials (ERPs) occur during oddball learning EEG experiments under conditions that ART predicted should occur during sequences of mismatch, arousal, and STM reset events, respectively.
  Cognitive	Emotional	p541fig15.02 nSTART neurotrophic Spectrally Timed Adaptive Resonance Theory: Hippocampus can sustain a Cognitive-Emotional resonance: that can support "the feeling of what happens" and knowing what event caused that feeling. Hippocampus enables adaptively timed learning that can bridge a trace conditioning gap, or other temporal gap between Conditioned Stimuluus (CS) and Unconditioned Stimulus (US).

  
  backgound colours in the table signify :

  white	general microcircuit : a possible component of ART architecture
  lime green	sensory perception [attention, expectation, learn]. Table includes [see, hear, !!*must add touch example*!!], no Grossberg [smell, taste] yet?
  light blue	post-perceptual cognition?
  pink	"the feeling of what happens" and knowing what event caused that feeling

• p215fig05.28 Howell: grepStr 'mismatch|attentional cue|orienting arousal' don't want a new category for EACH network? I assume that there isn't only ONE [mismatch, pattern] detector for whole brain!!?
• p240fig05.44 Howell: grepStr 'local computations' what about TrNN basic unit as one of three questions for webSite? Hebbian comments elsewhere in book... :
  Grossberg: When an algebraic exemplar model is realized using only local computations, it starts looking like an ART prototype model. || How does the model know which exemplars are in category A? BU-TD learning. How does a NOVEL test item access category A?
• p356 Howell: grepStr 'Bayesian' - Robert Hecht-Nielon's "Confabulation Theory": some Bayesian successes are not Bayesian, possibly often when "naive Baye's assumption" is used? (Howell: I forget the details)
• p362fig10.11 Howell: ?comment or question?
  Grossberg: Feedback between layer 2/3 to the layer 6-to-4-to-2/3 feedback loop chooses the strongest grouping in cases where there is more than one. If only one grouping exists, then the circuit can function very quickly in a feedforward manner. When multiple groupings exist, the cortex "runs as fast as it can" to select the one with the most evidence to support it using the self-normalizing inhibition in the layer 6-to-4 off-surround.
• p372fig11.02 Howell: Artists sometimes "fade out [color, detail]s" with distance. This seems to be covered by the brightness process?
  Grossberg: FACADE theory explains how multiple depth-selective boundary representations can capture the surface lightnesses and colors at the correct depths. The fact that both surface qualia and qualia and depth are determined by a single process implies that, for example, a change in brightness can cause a change in depth.
• p376fig11.08 Howell: "Multiple Conflicting Hypothesis" (MCH) theme
  Grossberg : The contrast constraint on binocular fusion is not sufficient to prevent many of the false binocular matches that satisfy this constraint. || How to solve the correspondance problem? How does the brain inhibit false matches? Contrast constraint is not enough. [stimulus, multiple possible binocular matches] - Which squares in the two retinal images must be fused to form the correct percept?
• p402fig11.44 Howell: amazing results from the 3D LAMINART model, Disparity [5, 6, 8, 10, 11, 14]: images of objects in common depth planes. But could simple parallax processing produce much of the same?
  Grossberg: 3D scenic reconstruction of the image in Figure 11.43 by the 3D LAMINART model. || Disparity [5, 6, 8, 10, 11, 14]: images of objects in common depth planes
• p416fig12.13 Howell: DIRECT model reaching: reminds me of awesome work by Jan Peters & colleagues (Technische Universitaet Darmstadt, Germany) "Robot Learning" (he zoomed 21Jun2022)
  Howell: DIRECT model reaching: reminds me of Yoonsuck Choe etal work on Evolutionary Computation: autonomous emergence of tool use.
  Grossberg: The DIRECT model learns, using a circular reaction that is energized by an Endogenous Random Generator, or ERG, to make motor-equivalent volitionally-activated reaches. This circular reaction learns a spatial representation of a target in space. It can hereby make accurate reaches with clamped joints and on its first try using a tool under visual guidance; see Figure 12.16. || DIRECT model (Bulloch, Grossberg, Guenther 1993). learns by circular reaction. learns spatial reresentation to me4diate between vision and action. motor-equivalent reaching. can reach target with clamped joints. can reach target with a TOOL on the first try under visual guidance. How did tool use arise?!
• p419fig12.17 Howell: important indicator of resonance, which is a requirement for consciousness (but not all resonance is conscious)
  Howell: grepStr 'auditory continuity' - DeLiang Wang "Auditory scene analysis"
  Grossberg: The auditory continuity illusion illustrates the ART Matching Rule at the level of auditory streaming. Its "backwards in time" effect of future context on past conscious perception is a signature of resonance. ||
• p448fig12.46 Howell: Larger cells selectively code code longer lists? YES!!! architecture first -> function, process, operating system, etc
• Howell: errors of replacing "working memory (WM)" with "short-term memory (STM)" - I made this mistake many times in my re-typing of Grossberg's list of figures!!!
• p506fig13.35 Howell: "A shock, or other reinforcing event, can have multiple cognitive and emotional effects on different brain processes." 10Jun2023 This reminds me of "Thunderbolts theory" and the known reversal of permanent magnetic poles due to a large electrical [shock, current].
  Grossberg: A shock, or other reinforcing event, can have multiple cognitive and emotional effects on different brain processes. || Multiple functional roles of shock. 1. Reinforcement sign reversal:
• p523fig14.03 Howell: Reminds me of Asim Roy, Arizona State University: posted comments on Connectionists over 2-5 years(?) regarding [concept, grandmother] cells, or the question if a neuron could represent a concept, as opposed to a "holographic law" that would prevent that. Interesting argument exchanges.
  Grossberg: (a) The MOTIVATOR neural model generalizes CogEM ... Reciprocal adaptive connections btween hypothalamus and amygdala enable amygdala cells to become learned value categories. ...
• Howell: Do you have to understand the subconscious processes in order to understand conscious processes? 1. Yourself - No. That's kind of a definition of consciousness or its effect. We do not understand the details of the subconscious, and don't know how it works, and that's fine. [Philosopy, classical science] are based on simple [rational, logical, scientific] reasoning, and they work OK. 2. Conscious systems construction: YES, you do have to undeerstand sub-conscious processes, and in order to do that you have to tie into them.
• p578fig16.04 Howell: reminds me of work by Ted Berger etal on hippocampal prosthesis regarding conversion of short-term to long-term memory, "telepathic rats" (fun even if crazy).
  Grossberg: Cross-sections of the hippocampal regions and the inputs to them. See the text for details.
• Howell: 11Jun2023 Does one need to understand sub-conscious [architecture, process]s in order to understand consciousness? For most people, NO. Consciousness is all you need, for example almost all concepts of consiousness to date, from philosophy to [Bernard Baars, Dehaene global workspace model] and almost all other concepts. For those building substantive models of consciousness, YES. [Philosophy, Poetry, Yapping and arm-waving] aren't enough, and don't lead to [profound, workable] understanding. Still, they may be inspiring, there are [needles in the haystack, gems in the rough], and a few may lead somewhere.
• p586fig16.16 Howell: note use of term "back-propagating", albeit perhaps somewhat different from standard back-propagation in ANNs.
  Grossberg: In the place cell learning model of (Gorchetnikov, Grossberg 2007), three populations of five cells each of entorhinal grid cells (only two are shown) with different spatial periods input to the model's dentate gyrus. The grid cells are one-dimensional and defined algorithmically. A model dentate gyrus granule cell that receives strong projections from all three grid cell scales fires (green cell) and activates a recurrent inhibitory interneuron that inhibits other granule cells. It also generates back-propagating action potentials that trigger learning in the adaptive weights of the projections from the grid cells, thereby causing learning of place cell receptive fields. || Grid-to-place Self-Organizing map (Gorchetnikov, Grossberg 2007). Formation of place cell fields via grid-to-place cell learning. Least common multiple: [grid (cm), place (m)] scales: [40, 50, 60 (cm); 6m], [50, 60, 70 (cm); 21m], [41, 53, 59 (cm); 1.282 km]. Our simulations: [40, 50 (cm); 2m], [44, 52 (cm); 5.72m]. Our SOM: Spiking Hodgkin-Huxley membrane equations; Nonlinear choice by contrast-enhancing recurrent on-center off-surround net;. Choice triggers back-propagating action potentials that induce STDP-modulated learning on cell dendrites.
• p079 Howell: grepStr 'noise suppression|rate spectra' - Gerald Pollack: likes attract likes, speaking of ions (effect of inter-layer)
• p591 Howell: grepStr 'noise suppression|rate spectra' - Gerald Pollack: cell membranes are NOT needed for ionic differences [in, out]side of cells, it's possibly gel phase of water?! (4th phase after [solid, liquid, gas], ignoring plasma)
• p598fig16.34 Howell: wow! theta rythm modulates place and grid cell firing? Wolfgang Singer: gamma dis-synchrony and schizophrenia (and/or autism)? Goes with theme of Schumann electro-magnetic resonances in atmosphere between ionosphere & ground?
  Grossberg: The spiking GridPlaceMap model generates theta-modulated place and grid cell firing, unlike the rate-based model. || Theta-modulated cells in spiking model. [place, grid] cell vs [membrane potential (mV vs time), frequency vs inter-spike intervals (s), power spectra (normalized power vs frequency (Hz))].
• p609 Howell: grepStr 'theta|gamma|beta|delta' - Schumann resonances in atmosphere down to Earths surface are the same as well-established brain waves.
• p??? Howell: grepStr 'Explainable AI' - Grossberg explains how ART easily leads to IF-THEN rules... somewhere in book